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Abstract 

Background: Few educational resources have been developed to inform patients' renal replacement therapy (RRT) 
selection decisions. Patients progressing toward end stage renal disease (ESRD) must decide among multiple 
treatment options with varying characteristics. Complex information about treatments must be adequately 
conveyed to patients with different educational backgrounds and informational needs. Decisions about treatment 
options also require family input, as families often participate in patients' treatment and support patients' decisions. 
We describe the development, design, and preliminary evaluation of an informational, evidence-based, and 
patient-and family-centered decision aid for patients with ESRD and varying levels of health literacy, health 
numeracy, and cognitive function. 

Methods: We designed a decision aid comprising a complementary video and informational handbook. We based 
our development process on data previously obtained from qualitative focus groups and systematic literature 
reviews. We simultaneously developed the video and handbook in "stages." For the video, stages included (1) 
directed interviews with culturally appropriate patients and families and preliminary script development, (2) video 
production, and (3) screening the video with patients and their families. For the handbook, stages comprised (1) 
preliminary content design, (2) a mixed-methods pilot study among diverse patients to assess comprehension of 
handbook material, and (3) screening the handbook with patients and their families. 

Results: The video and handbook both addressed potential benefits and trade-offs of treatment selections. The 
50-minute video consisted of demographically diverse patients and their families describing their positive and 
negative experiences with selecting a treatment option. The video also incorporated health professionals' 
testimonials regarding various considerations that might influence patients' and families' treatment selections. The 
handbook was comprised of written words, pictures of patients and health care providers, and diagrams describing 
the findings and quality of scientific studies comparing treatments. The handbook text was written at a 4 th to 6 th 
grade reading level. Pilot study results demonstrated that a majority of patients could understand information 
presented in the handbook. Patient and families screening the nearly completed video and handbook reviewed the 
materials favorably. 

Conclusions: This rigorously designed decision aid may help patients and families make informed decisions about 
their treatment options for RRT that are well aligned with their values. 
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Background 

Patients whose advanced chronic kidney disease (CKD) is 
approaching end-stage renal disease (ESRD), or complete 
kidney failure, face complex medical decision-making 
regarding the type of medical therapy they wish to pursue. 
Choices for treating ESRD are numerous and include 
renal replacement therapies (RRTs) such as hemodialysis 
delivered in a dialysis center three times per week, home 
care dialysis (including peritoneal dialysis and home 
hemodialysis, which patients administer to themselves 
daily), and living or deceased kidney transplantation. 
Patients may also choose to forgo RRT and instead opt for 
conservative medical therapy (i.e., ongoing medical care 
with their nephrologists to optimize health without dialy- 
sis or kidney transplantation). Each treatment option has 
different advantages, limitations, and implications for 
survival, quality of life, financial stability, general health 
status, and how patients experience their daily lives [1-3]. 
For instance, home dialysis therapies require patients' sub- 
stantial self-care and may afford patients more control 
over their daily schedules, while in-center hemodialysis 
requires less self-management but more frequent interface 
with medical professionals and may offer patients less 
autonomy [4]. Patients' families are also impacted by RRT 
decisions, as they often play substantial caregiver roles [5]. 

Despite patients' critical need to understand the char- 
acteristics of various RRTs to inform their treatment 
decisions, many patients report having little to no gen- 
eral awareness of what types of treatment options exist 
for ESRD and many have little knowledge of treatment 
risks and benefits prior to their initiation of RRT [2,5-9]. 
Patients' poor access to adequate education about treat- 
ments has been linked to their abrupt initiation of dialy- 
sis and their suboptimal access to other forms of RRT, 
[10,11] such as kidney transplantation, which is asso- 
ciated with improved clinical outcomes [6,12-14]. A sub- 
stantial proportion of patients with ESRD are elderly and 
may have low educational attainment, poor health literacy 
and numeracy, and cognitive decline associated with their 
advancing kidney disease, heightening the challenges of 
educating patients about their RRT choices [15-18]. 

Comprehensive decision aids are needed to help patients 
with kidney disease and their families make informed RRT 
selection decisions aligned with their personal values. This 
paper describes our development of a patient-and-family 
centered decision aid to inform RRT selection decisions. 

Methods 

Overarching goals, decision Aid content, and approach to 

decision Aid design 

Goals 

We sought to develop a patient-and-family centered de- 
cision aid (handbook and video) to help patients and 
families choose among numerous RRT options. We 



sought to ensure that the decision aid could be under- 
stood by patients with a range of health literacy, health 
numeracy, and cognitive needs. We used the 2006 Inter- 
national Patient Decision Aids Standards (IPDAS) to 
guide our development process [19]. All aspects of the 
decision aid design, including the collection of primary 
patient and family data to inform development, were 
approved by the Johns Hopkins Medicine Institutional 
Review Board. 

Decision aid content 

We intended for the decision aid to address both posi- 
tive and negative features of treatment options that 
patients (who had previously experienced treatments) 
and their family members felt others making RRT deci- 
sions should know about. We identified content to in- 
clude via: (1) our own conduct of 20 focus groups of 
patients and families identifying information they felt 
should be included in decision aids guiding others' RRT 
selections (described elsewhere) [5] as well as our select- 
ive review of qualitative studies published by other 
investigators, [2,3,20] and (2) our conduct of rigorous 
systematic literature reviews describing findings of scien- 
tific studies comparing outcomes among patients select- 
ing different RRTs (described elsewhere) [21-24]. Our 
decision aid focused on seven key content areas or "con- 
cerns" about treatments, including how treatments 
might affect patients': (1) morbidity and mortality 
("health problems"), (2) autonomy ("doing things"), (3) 
treatment delivery ("how treatment works"), (4) symp- 
toms ("symptoms"), (5) relationships ("relationships"), 
(6) psychological well being ("feelings"), and (7) finances 
("money matters") (Table 1). 

Approach to designing the decision aid 

We intended for the video and handbook to present 
complementary subjective (in video) and evidence-based 
(in handbook) information to a diverse English-speaking 
audience. We developed the video and handbook simul- 
taneously in three "stages" (Figure 1). We engaged a 
multidisciplinary group of experts throughout the devel- 
opment process, which included clinical experts (physi- 
cians, social workers), an adult health education 
specialist, a patient advocacy specialist, a video script- 
writer, and a medical illustrator. 

Methods: developing the video 

We intended to provide patients and their families with 
specific testimonials from others who had already made 
treatment decisions. We attempted to ensure these testi- 
monials addressed as many of the seven previously identi- 
fied "concerns" as possible. When patients or families did 
not address "concerns" in their testimonials, or if deemed 
appropriate, we incorporated testimonials from health care 
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Table 1 Topics addressed in the decision aid 



Concern 


Factor Video Handbook 


Morbidity/ 


Living longer 


Mortality 




("Health 


InfprtinrK • • 


Problems") 


Complications with surgery 




Making frequent trips to the 




doctor 




Going to the hospital 


Autonomy ("Doing 


Doing things 1 want to do 


Things") 


when 1 want to do them 




Doing my usual activities 




Freedom and control over • • 




my life 




What 1 can eat or drink 




Control over my treatment 




schedule 




Going places by myself 




My quality of life 




My social life 




Ability to do things in my 




free time 




How much free time 1 have 




How 1 feel about traveling 




Ability to go to work 




What 1 can do at work 




How 1 feel about my work 




My job and money 




How free 1 feel to do things 




Ability to do day-to-day tasks 




My ability to get around • 




How 1 feel about getting 




around 




Caring for myself 


Treatment 


Dialysis/transplant going as 


Delivery ("How 


expected 


Treatment Works") 


Pilk 1 bi3\/p tn t^kp • 

r iiio i i lave Lai\C 




Providing my own treatment • 




Ordering/storing supplies at 




home 




Fistula or catheter problems • 




Finding a living donor 




Surgery for fistulas or 




catheters 




Blood tests, x-rays, and 




doctor visits 


Symptoms 


Feeling tired 


("Symptoms") 


Thinking clearly 




My memory 




My attention 




How well 1 can learn 




Itching, cramping, or aching 



Table 1 Topics addressed in the decision aid (Continued) 

Gaining weight 
Pain 

Joint pain 

How healthy my body feels 

My energy 

Cramps 

Stomach problems 
Bowel problems 
Cough 

Trouble breathing 
Skin problems 
Dry skin 

Changes in skin color 

How well I sleep 

How I feel about my looks 

Relationships Family and friends need to 

("Relationships") help 

Making new friends 

Having and enjoying sexual 
relations 

Sex drive 

Orgasm problems 

Pain with sex 

Erection problems (Men) 

Ejaculation problems (Men) 

Chances of having sex (Men) 

Trouble getting excited 
(Women) 

Vaginal dryness (Women) 

Psychological Feeling sad, anxious, or 

("Feelings") stressed out 

Chances of being depressed • 

My nerves 

My well-being 

My emotions 

My mood 

How happy I am with my 
life 

Finance ("Money Money spent from own 
Matters") pocket 



professionals who could provide additional views regarding 
common patient experiences relevant to the "concerns." 

Video development stage 7: selecting patients and families 
for the video, writing the script 

Engaging a scriptwriter We engaged a professional 
video scriptwriter with experience creating medical 
education videos. The scriptwriter reviewed findings 
from our foundational research and worked with our 
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investigative team to develop questions designed to elicit 
positive and negative viewpoints from patients and fam- 
ilies about their chosen RRTs. 

Selecting patients and families and writing the script. 
We worked with local nephrologists in Baltimore, MD 
to identify a diverse group of patients who might poten- 
tially participate in the video. We asked nephrologists to 
select patients receiving different forms of RRT with 
specific demographic characteristics (e.g., minority female 
who received a transplant) to ensure diversity. The script- 
writer conducted 90 to 120 minute directed interviews 
with patients and family members and recorded the con- 
tent of interviews for review. 

The scriptwriter then drafted a script by incorporating 
views she obtained from patients and families. In our 
previously conducted focus groups, patients and families 
identified health care professionals they thought would 
be appropriate to address various "concerns." For ex- 
ample, patients and family members felt physicians 
would be appropriate for discussions about the health 
risks and benefits associated with treatment selections, 
while social workers would be more appropriate for dis- 
cussing financial considerations. Our investigative team 
reviewed the script and refined it to ensure all seven 
"concerns" were adequately addressed by either patients 
and families or health professionals (which included a 
transplant nephrologist, transplant social worker, general 
nephrologist, and dialysis social worker). 

We also ensured that the video addressed complemen- 
tary information to the handbook. Because the handbook 
summarized findings from scientific studies about the 
various RRT options (e.g., differences of health risks asso- 
ciated with different therapies), we did not include this 
type of quantitative information in the video (Table 1). 

Video development stage 2: producing the video 

Filming and producing the video A professional video 
production crew filmed patients and family members in 
their homes during scheduled visits. To obtain testimo- 
nials on camera, an investigative team member inter- 
viewed them using the same questions the scriptwriter 
asked during initial directed interviews. The crew filmed 
health care personnel in a studio. An investigative team 
member asked health care providers questions to address 
issues that patient testimonials did not already address. 
After completing video filming and editing, we iteratively 
refined the video, focusing on decreasing length and im- 
proving clarity, consistency, and accuracy. 

Video development stage 3: video screening and final edits 

Screening groups Prior to final editing, we recruited 
five patients receiving different RRTs from two local, 



academically affiliated nephrology practices in Baltimore, 
MD and seven of the patients' family members to screen 
the video and provide their qualitative feedback during a 
two hour group meeting led by a trained moderator. 
The moderator elicited participants' initial impressions 
of the video as well as feedback regarding length, 
amount of information presented, understandability, the 
balance in presentation of positive and negative aspects 
of the treatments, and areas for improvement. We 
audio-recorded and transcribed screening group discus- 
sions and we incorporated screening groups' feedback in 
our final iterations. 

Methods: developing the handbook 

The handbook complemented the video (Table 1) and 
summarized findings from scientific studies about differ- 
ences in patient-reported and clinical outcomes among 
patients receiving different treatment options (in-center 
hemodialysis, peritoneal dialysis, kidney transplantation, 
and medical therapy with no dialysis or transplantation). 
We also provided information about the methodological 
quality of scientific studies. The handbook focused on 
the same seven "concerns" highlighted in the video. 

Handbook development stage 1: preliminary handbook 
content design by our investigative team 

We worked with specialists in medical illustration, adult 
education, health communications, and in adapting 
materials for low literacy readers to develop the hand- 
book. We created several mock designs for presenting 
information before conducting the pilot study. 

Handbook development stage 2: mixed-methods pilot study 
to guide iterative design 

During early handbook development, we confronted 
three main challenges, including (1) presenting informa- 
tion about differences in multiple treatment types, (2) 
presenting information quantifying the magnitude and 
direction of scientific findings that did not incorporate 
risk probabilities and could not be described using 
standard methods (e.g. pictograms or bar graphs), [25] 
and (3) communicating information to patients about 
the quality of scientific evidence available to inform a 
decision. [26] To help address these challenges, we per- 
formed a pilot study among patients with kidney disease 
to obtain their input on the clarity of information we 
presented in various handbook iterations. 

Pilot study goals, setting, and participants In two 

study "phases," we recruited a total of 48 English-speaking 
patients from two local nephrology practices in the 
Baltimore, MD metropolitan area to obtain qualitative 
feedback on handbook material (Phase 1 and 2) and quan- 
titatively test patients' comprehension of handbook 
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Foundational Research 

Conducted 20 focus groups, a selective review of qualitative studies by other investigators, and systematic 
literature reviews to identify patients' and families' concerns and informational needs regarding renal 
replacement therapy 



Video Development (17 total iterations) 



Stage 1 (26 months, 11 script iterations) 

• Multidisciplinary team of experts developed a 
preliminary structure for the video and handbook 
to ensure their complementary nature and 
attention to seven key content areas 

• Selected a diverse group of patients receiving 
different renal replacement therapies, their 
family members, and health care professionals 
for potential participation in the video 

• Conducted directed interviews to acquire patient 
and family member testimonials regarding their 
treatment experiences and draft an initial video 
script 



Stage 2 (12 months, 3 video iterations) 

• Filmed patient, family member, and provider 
testimonials addressing seven key content areas 

• Edited the video 

• Produced a video draft suitable for screening 



Stage 3 (4 months, 3 video iterations) 

• Screened a video draft to obtain qualitative 
feedback from patients and family members (12 
participants total) 

• Produced a final version of the video 



Handbook Development (26 total iterations) 



Stage 1 (12 months, 3 iterations) 

• Multidisciplinary team of experts developed a 
preliminary structure for the video and handbook to 
ensure their complementary nature and attention to 
seven key content areas 

• Worked with a medical illustrator, adult education 
specialist, communications specialist, and a literacy 
expert to establish a preliminary standard format for 
presenting scientific information to patients 



Stage 2 (15 months, 22 iterations ) 

• Performed a two-phase mixed-methods study 

Phase 1, 16 iterations 

• Conducted cognitive interviews with 12 patients to 
obtain critical feedback regarding the 
understandability of information presented and 
identify areas for improvement 

Phase 2, 6 iterations 

• Performed an additional 36 cognitive interviews to 
obtain quantitative measures of comprehension and 
qualitative input on the presentation of information 

Stage 3 (2 months, 1 iteration) 



Screened a handbook draft to obtain qualitative 
feedback from patients and family members (12 
participants total) 

Produced a final version of the handbook 



Figure 1 Decision aid development process. 



material (Phase 2 only) during the iterative design process. 
For both phases, we asked nephrologists to identify 
patients either on dialysis or with progressive CKD ("Pre- 
ESRD," defined as estimated glomerular filtration rate of 
less than 30 ml/min/1.73 m 2 ) but not yet receiving dialysis 
or a kidney transplant. We then approached patients to 
assess their interest in participating in cognitive 
interviews. 

Phase 1 cognitive interviews During study Phase 1, we 
performed cognitive interviews with 12 patients with 
kidney disease to obtain feedback regarding the under- 
standability of the information and ways to improve in- 
formation presentation. We provided participants with a 
binder that included 8 to 14 sample handbook pages. 
After participants reviewed each sample handbook page 
a trained interviewer asked six open-ended questions: 1) 
"Please tell me what you think the information on this 
page means," 2) "What does (fill in topic name) mean to 
you?" 3) "We re not sure if these are the best words to 



use, if you think there is a better way, we'd like to hear 
it," 4) "Is any part of this page unclear?" 5) "Do you have 
any other suggestions?" and, 6) "On a scale of 1-5, with 
1 being very hard to use and 5 being very easy to use, 
how would you score your ability to use this picture and 
the words to understand the information?" We audio- 
recorded and transcribed each interview. We reviewed 
transcriptions and made iterative changes to the hand- 
book to address participants' comments. 

Phase 2 cognitive interviews and assessment of com- 
prehension During study Phase 2, we performed 36 
additional cognitive interviews. As with Phase 1, we 
asked participants to provide qualitative feedback 
regarding the understandability and usability of informa- 
tion. In study Phase 2, we also assessed participants' 
"gist" comprehension [27,28] of five key aspects of scien- 
tific evidence presented on each page, including whether 
they could understand: (1) the topic ("What issue are 
we talking about on this page?"), (2) the treatment 
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modalities ("What treatments are being compared on 
this page?"), (3) the direction of differences in outcomes 
between RRTs being portrayed ("Which treatment is bet- 
ter?"), (4) the magnitude of difference in outcomes be- 
tween RRTs ("How much better or worse is one 
treatment versus the other?"), and (5) the research qual- 
ity of scientific studies to inform that aspect of the deci- 
sion ("Does the page tell people how good the 
information is?"). 

We asked participants to view 7 to 9 different sample 
handbook pages displaying similar types of information 
(including information addressing five key aspects of scien- 
tific evidence: topic, treatment modalities being compared, 
direction of differences between treatments, magnitude of 
differences, and research quality). We assessed participants' 
gist comprehension of each key aspect on each page. Two 
independent investigators reviewed transcripts of each 
audio-recorded interview to assess participants' gist com- 
prehension and scored participants' responses as correct or 
incorrect. A third research team member adjudicated any 
discrepancies among the two reviewers by also reviewing 
the transcripts. 

For each key aspect of scientific evidence, we calcu- 
lated the number of pages for which participants cor- 
rectly demonstrated comprehension. For example, if a 
participant demonstrated correct comprehension of the 
treatments displayed on 7 of 9 pages, we assessed that 
participant as having correct comprehension of this 
element 78% of the time. We then summarized the total 
group's comprehension of each element by calculating 
the median (range) of all participants' percentages indi- 
cating correct comprehension of that element. We also 
assessed patient participants' demographic characteris- 
tics; health literacy (Rapid Estimate of Adult Literacy in 
Medicine) [29]; numeracy level (Risk Numeracy) [30]; 
cognitive function (Trails B) [31]; and knowledge and 
awareness of kidney disease [7]. 

Handbook development stage 3: handbook screening and 
final edits 

Patients and family members who participated in the video 
screening (described above under "Video Development, 
Stage 3") also reviewed the handbook and provided opi- 
nions to the same open-ended questions. 

Results 

Feedback we received during each phase resulted in 
numerous iterative refinements of both the video and the 
handbook. We iteratively refined the video 17 times 
(11 script iterations in Stage 1, three initial video iterations 
in Stage 2, and three final film iterations in Stage 3). We it- 
eratively refined the handbook 26 times (three iterations in 
Stage 1, 22 iterations in Stage 2, and one final iteration in 
Stage 3). Examples of preliminary handbook presentations, 



reflecting major iterative design approaches from Stages 1 
and 2, are presented in Figure 2. 

Results: findings from mixed methods pilot study 

Of the 12 participants in pilot study Phase 1, 67% were 
male, 92% were African American, and 75% had at most 
a high school degree or GED. The majority of parti- 
cipants were on hemodialysis (n=9, 75%), while the 
remaining participants were classified as pre-ESRD (n=3, 
25%). Of the 36 participants in Phase 2, 44% were male, 
83% were African American, and 47% had at most a high 
school degree or GED. Fifty-four percent of phase 2 par- 
ticipants were on hemodialysis, 33% were considered 
pre-ESRD, 29% on peritoneal dialysis, and 17% on home 
hemodialysis. Participants in both phases were diverse 
with respect to their knowledge of kidney disease, liter- 
acy, numeracy, and cognitive function (Table 2). 

Qualitative feedback obtained during cognitive inter- 
views (during Phase 1 and Phase 2) focused on three key 
areas: (1) difficulties identifying the multiple treatment 
types presented in the handbook, (2) the handbook 
containing an intimidating amount of complex scientific 
information, and (3) their desires to have numerical 
or quantitative information from scientific studies pre- 
sented in a way that was clear and understandable. 
Through a total of 22 iterations (16 iterations in Phase 1 
and six iterations in Phase 2) we addressed these concerns 
through numerous adjustments (including the use of color 
coding to consistently identify RRT options when discussed 
throughout the handbook, providing explanatory guides 
for how to read pages, eliminating the use of abbreviations, 
and supplementing graphical numerical presentations with 
text written at a 4 th to 6 th grade reading level) (Table 3). 

During study Phase 2, we measured gist comprehension 
of materials among a total of 36 participants. Twenty-four 
(24) participants provided feedback on iteration 20 of the 
handbook and 12 participants provided feedback on 
iteration 21 of the handbook. Among all items viewed by 
participants, participants demonstrated median gist com- 
prehension of 78% (range: 15%-100%) in iteration 20. Par- 
ticipants' median overall gist comprehension rose to a 
median of 91% (range: 9%-100%) in iteration 21. Par- 
ticipants demonstrated greatest gist comprehension on 
aspects of pages reflecting the topic being discussed, the 
treatment types (modalities) being compared, and the 
direction of scientific findings discussing treatment differ- 
ences (i.e., they could correctly identify one treatment was 
better than the other). Participants demonstrated less gist 
comprehension regarding the magnitude of treatment 
differences (i.e., they had difficulty understanding how 
much better one treatment was than another) and infor- 
mation about the research study quality. However, gist 
comprehension scores improved in these areas between 
iterations 20 and 21 (Table 4). 
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Results: feedback from decision Aid screening 

Five patients and seven family members participated in 
two different screening groups. Patient participants were 
80% female, 60% African American, and 60% had at least 
two years of college education. All family member parti- 
cipants were female, 71% were African American, and 
43% had at least two years of college education. 

Patients and family members provided mostly positive 
feedback after screening both the video and handbook. 
(Table 5) Participants often commented that they liked 
the organization of the video and the breadth of topics it 
covered. Participants also commented on the comple- 
mentary nature of the two materials. Screening group 
participants constructively criticized the large amount of 
information presented in the handbook. To address this 
concern, we created a mini-book entitled, "All of the 
Facts," to accompany the handbook, which provides 
readers with a brief summary of key information pre- 
sented in the longer handbook. 

Results: final decision Aid 

The final decision aid consists of a 50-minute video and 
a comprehensive, 159-page handbook accompanied by a 
14-page mini-book ("All of the Facts") which sum- 
marizes the key information in the handbook. Together, 
the video and handbook satisfied 92% of all quality 



criteria outlined in the three subject areas designated by 
IPDAS (satisfied 96% or 22 of 23 content items, 87% or 
20 of 23 development process items, and 100% or 6 of 6 
effectiveness items) (Additional file 1). 

The video provides testimonials from minority and 
non-minority (male and female) patients, their family 
members, and health care professionals (physicians and 
social workers) about "concerns" patients and their 
families might have which could influence their RRT 
selection decisions. These "concerns" correspond to the 
seven key content areas patients and their families iden- 
tified as important to include in the decision aid during 
our foundational research studies. Patients and family 
members receiving different RRTs share subjective testi- 
monials describing their positive and negative experi- 
ences with these "concerns" in the video. Health care 
providers discuss additional information regarding "con- 
cerns" to balance patient and family views and to con- 
tribute additional information. 

The handbook provides evidence-based information 
regarding risks and benefits of different treatment options 
of peritoneal dialysis, in-center hemodialysis, home 
hemodialysis, kidney transplant, and conservative manage- 
ment (treatment with no transplant or dialysis) as they 
pertain to these same patient concerns. The introduction 
includes a section that defines kidney disease ("What Is 
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Table 2 Participant characteristics for handbook 
development Stage 2 (Phases 1 and 2) 



Patient 

characteristics, 


All participants 
(Phases 1 & 2) 


Phase 1 
participants 


Phase 2 
participants 


n(%) 


(n=48) 


(n=12) 


(n=36) 


Age 


Mean [Range] 


59 [33-85] 


58 [46-71] 


60 [33-85] 


Gender 


Male 


24 [50%] 


8 [67%] 


16 [44%] 


Race/Ethnicity 


African American 


41 [85%] 


11 [92%] 


30 [83%] 


non-African 
American 


7 [15%] 


1 [8%] 


6 [1 7%] 


Education 


Less than a high 
school degree 


9 [19%] 


4 [33%] 


5 [14%] 


High school 
degree/GED 


1 7 [35%] 


5 [42%] 


12 [33%] 


Some college 


14 [29%] 


3 [25%] 


11 [31%] 


Bachelor's degree 


6 [13%] 


0 [0%] 


6 [1 7%] 


Graduate or 
professional school 


2 [4%] 


0 [0%] 


2 [5%] 


Treatment Group 


Pre-ESRD 


15 [31%] 


3 [25%] 


12 [33%] 


Hemodialysis 


22 [46%] 


9 [75%] 


13 [54%] 


Home Hemodialysis 


4 [8%] 




4 [1 7%] 


Peritoneal Dialysis 


7 [15%] 




7 [29%] 


Knowledge of 
Kidney Disease § 


Extensive 
knowledge 


4 [8%] 


1 [8%] 


3 [8%] 


A great deal of 
knowledge 


20 [42%] 


4 [33%] 


16 [44%] 


Some knowledge 


18 [38%] 


7 [59%] 


11 [31%] 


Limited to no 
knowledge 


5 [10%] 


0 [0%] 


5 [14%] 


Don't know 


1 [2%] 


0 [0%] 


1 [3%] 


Literacy 


3 rd grade and 
below 


5 [10%] 


1 [8%] 


5 [14%] 


4th to 6 th grade 


4 [8%] 


2 [1 7%] 


2 [5%] 


7 th to 8 th grade 


14 [29%] 


6 [50%] 


8 [22%] 


9 th grade and 
above 


25 [52%] 


3 [25%] 


22 [61%] 


Numeracy 


Risk numerate 6 


14 [30%] 


3 [25%] 


11 [31%] 


Cognition ¥ 


Cognitive 
impairment 


10 [21%] 


3 [25%] 


7 [19%] 



§ Based on self-report. 

¥ Time of 273 seconds or longer indicates a cognitive deficiency, 2 participants 
missing data from Phase 2. 

Considered risk numerate if 3 of 3 risk numeracy questions answered 
correctly, 1 participant missing from Phase 2. 



Kidney Disease?"), describes and color codes the different 
treatment options ("What are the Treatments?"), presents 
a value clarification exercise to help patients determine 
which treatment is best for them ("How Do I Choose a 
Treatment?"), and orients the reader to the page layout 
("What is on Each Page?"). Subsequent sections of 
the handbook describe summaries of scientific studies 
relevant to each "concern." Handbook pages are 8.5" by 
11" and oriented toward a 4 th to 6 th grade reading level. 
The handbook delivers content on a double-page spread 
layout to appeal to diverse learning preferences: the left- 
hand page includes brief statements summarizing key 
messages from scientific studies while each right-hand 
page presents a more detailed summary of study findings 
and a graphical presentation of data (Figure 3). 

Discussion 

Patients need high quality decision aids to help guide 
them through the decision-making process about RRT 
selection. To our knowledge, rigorous and systematic 
approaches to developing decision aids for patients with 
CKD have not been previously undertaken. We devel- 
oped our decision aid to accommodate patients with 
varying literacy, numeracy, and cognitive needs. The 
final decision aid achieved the vast majority of IPDAS 
criteria for engaging patients in informed decision-mak- 
ing. Our refinement process incorporated 11 video script 
iterations and 26 handbook iterations, reflecting the 
extensive effort we undertook to develop materials that 
addressed patients' self-reported informational needs. 
Initial screening of our decision aid by patients and their 
families indicates that these materials are likely to be 
well received. Pilot testing in our mixed-methods study 
suggested patients found the final handbook understand- 
able. However, further testing is still needed to deter- 
mine how effective or useful the decision aid is for 
ESRD patients' treatment decisions. 

Our development process and findings highlight some 
of the challenges of developing comprehensive materials 
for a diverse population that address the positive and 
negative features of various RRT options. First, we based 
our content on rigorous foundational studies (20 focus 
groups and systematic literature reviews), which required 
substantial time and effort to conduct. Translating our 
findings from these studies to inform decision aid devel- 
opment also proved challenging as we sought to address 
multiple concerns identified by patients and invested 
additional significant time and effort performing the 
mixed-methods pilot study to identify ways to convey 
scientific information in a way that can be easily inter- 
preted by the vast majority of patients. Further, factors 
such as the layout of information and the inclusion of 
figures are known to be potential sources of bias in deci- 
sion making. For instance, the final handbook (150 pages) 
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Table 3 Qualitative feedback from handbook development Stage 2 (Phases 1 and 2) 



Patient concerns 



Representative quotes 



Specific challenges 
encountered 



Solutions 



Patients did not know 
their treatment options 



Intimidating amount of 
complex information 



"First, can you explain the two treatments? 
What is the difference between those two 
treatments?" 



"And I just feel like this is so much 
information that's written that is not 
going to be taken in." 



• Defining patients' various 
treatment options 



• Added a treatment definition page ("What 
are the Treatments?") 

• Replaced all abbreviations with actual 
treatment names 



• Making complex medical 
terminology memorable 

• Translating research 
evidence into plain language 



• Color-coded each treatment option 

• Associated each treatment with its own icon 

• Developed a question and answer format in 
plain language 

• Revised the language in the to achieve a 
fourth grade reading level 

• Created a new section ("What is on Each 
Page?") to introduce and define research 
quality 



• Communicating research 
quality 



• Used pictures of "real" doctors and patients 
diverse in age, sex, and gender 

• Placed tabs throughout the handbook to 
divide it into smaller sections 



• Making the handbook user- 
friendly 



• Added an interactive value clarification 
exercise ("How Do I Choose a Treatment?") 



Understanding numerical 
information or statistical 
concepts 



"I don't want these chances or things. . .it's 
real confusing. I want to know the facts." 



• Presenting graphical 
illustrations of data 



• Using both positive and 
negative framing of statistical 
information 

• Explaining effect size 



• Used graphical presentations patients 
responded to most positively 

• Supplemented graphical presentations with 
text to reiterate the intended message 

• Adopted a double page spread format to 
appeal to a diverse group of readers 

• Used an example study to anchor each 
head-to-head treatment comparison 

• Modified effect size terminology from a 
"small/medium/large amount" to "a little/ 
somewhat/ a lot better" 



and video (50 minutes) were lengthy. Although we did 
create a shorter "All the Facts" 14-page handbook in 
response to participants' comments during the screening 
sessions, we did not formally compare how participants 
viewed this distilled version of information compared to 
the complete handbook and video. Further testing will 
help clarify the optimum format for information. We are 
currently studying these materials in a randomized con- 
trolled trial to examine their influence on treatment deci- 
sions in African Americans [32], and we are designing 
additional studies to help further refine the decision aid. 

Incorporating subjective testimonials about treatment 
could introduce bias as patients may identify with video 
participants rather than synthesize information on pre- 
ference sensitive topics. [33-35] Nonetheless, treatments 
for ESRD are quite complex, requiring many practical 
considerations that significantly alter patients' daily lives. 
We therefore felt it was very important to show viewers 
examples of patients and families undergoing these 
treatments. For instance, our video shows a patient who 
receives home hemodialysis inserting a needle into his 



dialysis fistula. It shows another patient receiving 
hemodialysis in a treatment unit, and yet another patient 
administering peritoneal dialysis in her home with help 
from her spouse. The video depicts patients storing 
boxes of treatment supplies, handling medications, and 

Table 4 Median percentage** of times participants 
correctly comprehended key aspects of scientific 
evidence during pilot testing (handbook development 
Stage 2, Phase 2) 



Key aspects of 
scientific evidence* 


Iteration 20 


Iteration 21 


(n=24) 


(n=12) 


Topic 


100% [22%- 100%] 


100% [0%-100%] 


Treatment Modality 


100% [33%- 100%] 


100% [29%- 100%] 


Direction of Difference 


89% [22%- 100%] 


86% [14%-100%] 


Magnitude of Difference 


71% [0%-100%] 


100% [0%-100%] 


Research Quality 


56% [096-100%] 


100% [096-100%] 


Total: All Items 


78% [16%- 100%] 


91% [9%-100%] 



^Correct identification of five key items shown as a median percentage, 
followed by the respective range. 

**Ranges in the table represent [minimum-maximum] values. 
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Table 5 Positive and constructive feedback obtained from screening the decision aid 



Reactions 



Video 



Handbook 



Positive feedback 



Constructive feedback 



Positive feedback 



Constructive feedback 



Overall 
Impression 



Length 



Amount of 
Information 



Easy to 
Understand 



". . . if it was something like that 
available. . .when I started 
dialysis it would have really 
been welcome because 
information was 
scattered. . .And this, I like the 
way it's organized, the way it's 
broken down. . . I think it's 
touched just about on 
everything that your initial 
concerns would be." 



"But I didn't mind the length of 
it because it gave, you know, 
information that you need to 
know." 



"I think it's very informative and 
has just the right amount of 
information." 



"I did learn a lot of information 
from watching the movie. Even 
having some relatives that had 
kidney issues, this still provided 
more information." 



Balanced 
Presentation 
of Treatment 
Options 



Areas of 
Improvement 



"I don't think they leaned 
anywhere. In fact, they kept 
saying basically it was your 
options to select or decide 
which way you want to go and 
you even had an option to 
rescind that and go in another 
direction." 

Not applicable 



"What I did have an issue with 
was the sequence of, I liked the 
way everything was broken 
down but I think it should have 
been sequenced differently 
starting with dialysis at the 
center, because they said that 
was what's most frequently 
done, most frequently used." 



"I thought it was too long. But 
as it went on we could see 
how important it was for it to 
be that long and I think if I was 
in that situation, it might not 
have been that long but since 
it wasn't my issue, too long." 



Constructive feedback not 
available 



Constructive feedback not 
available 



"I really do love this book. It 
does give a whole lot of 
information for someone who's 
just starting out. You know, 
they really need all of the 
information they can-that they 
can get. And I love the fact that 
they would have a DVD to go 
along with it." 



"When I first saw it, it felt 
overwhelming but it was 
broken down so well that I can 
just go to the parts that I think 
are relevant to myself or that I 
want to see that day. . . it's 
separated so well that I can just 
go and look at it." 



"I think this is a terrific 
reinforcing publication plus 
when you're watching a film 
you can only remember so 
much whereas you're going to 
go back here and you're going 
to see all of it in the different 
forms. . . Reading and writing 
solidify your thinking. . .1 like it." 

"It's doesn't go to a junior high 
school level so that means that 
everybody can understand it. 
So yeah I think it's clear." 



Constructive feedback not 
available 



"Yeah it's pretty well balanced 
because it has the section for 
each treatment, you know, 
each mode in there so it's 
balanced." 



"A lot of times if a person is just 
starting dialysis, you know, you 
got the sluggishness in your 
brain, your memory, and your 
attention. And it might be a 
little hard to focus on this as 
opposed to seeing a film, 
hearing people's testimonies, 
you know, I think that would 
settle a little better than, you 
know, trying to absorb all of 
this." 

"I mean, the inside of it, the 
content is good. I like the 
graphics in it and the 
charts. . .but I guess if it was 
some kind of way you could 
kind of condense it because 
they're probably already getting 
a whole lot of other information 
at the same time to have to 
carry a big book." 

"It could be very daunting just 
even looking at it. But if you 
have a video hopefully it will 
pique your interest enough to 
be able to go to the individual 
area that you're concerned with 
and get that information that 
you need." 

"The spoken word, a lot of 
times, is much easier. I think the 
combination is a great vehicle, I 
do. But I think with this, you 
know, that's one of the things 
that I'd be concerned about. 
'Cause someone with a fifth 
grade reading level wouldn't 
really be able to understand 
everything." 

Constructive feedback not 
available 



"I think the one improvement Not applicable 

that I would suggest is that 

[they put] a little bit more 

emphasis in each type of 

treatment about the emotional 

impact on not just you but also 

your family and your support 

system." 



"I think the best part and most 
useful part for most of the 
population is the all the facts 
part. It's nice how they've 
compared the transplant, which 
is the ideal, to the other 
treatments. It might be helpful 
if there were a foldout where all 
the treatments were laid out 
like this to just read across." 
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Figure 3 Sample pages from final handbook. 
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traveling to the dialysis treatment facility. Without direct 
visualization, many patients considering these treat- 
ments may not fully comprehend the significant 
differences between therapies. Future studies will be 
needed to assess whether viewers of our video felt com- 
pelled to choose a treatment because of their subjective 
identification with video participants. 

Some additional limitations of our process are import- 
ant to consider. Although our team comprised experts 
from multiple disciplines, it did not include a decision 
scientist, which may have influenced our development 
approach. We did, however, refer to the decision sciences 
literature extensively as well as the IPDAS criteria through- 
out the development process [19,25-28,36-40]. We also 
developed our decision aid with input from a largely 
minority (African American) population of patients with 
kidney disease living in the Baltimore, MD metropolitan 
area. It is possible patients with different characteristics 
could have different viewpoints about RRT which might 
have altered our development process. Further, we devel- 
oped our decision aid for English-speaking patients. Mate- 
rials may require significant adaptation to accommodate 
reading and cultural needs of non-English speakers. 

Conclusion 

We developed a decision aid to help patients with kid- 
ney disease and their families make informed decisions 
about RRT selections aligned with their values. While 
our development process helped to ensure completeness 
and readability of our decision aid, its effectiveness on 
aiding patients' treatment decisions warrants further 
study. 

Additional file 



Additional file 1: IPDAS criteria met by video and handbook 
decision aid. 
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